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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
3/16/2010 has been entered. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

This application currently names joint inventors. In considering patentability of 

the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 

the various claims was commonly owned at the time any inventions covered therein 
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were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) 
prior art under 35 U.S.C. 103(a). 

Claims 1-2, 4-5, 7-9, 12-18, 20-26, 28, 30-35, 37-41, 44-45, 47-52, 54-62, 64-68, 
70-79, 82-87 and 89-90 and 94-95 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Deutscher (US 2004/0001106) in view of Chasen (US 6,760,721). 

As per claim 1 , Deutscher teaches a method comprising: receiving a request, 
from an application at an application programming interface (API), to interact with a 
plurality of media comprising streaming media [multimedia presentation production 
system and process of 0007]; and generating an original media timeline based on the 
request, wherein the original media timeline [timeline of 001 1 and 0026]: is exposed to 
the application via the API [timeline of 001 1 and 0026]; includes a plurality of nodes and 
defines a presentation, to be output via one or more computers, of a first said media 
referenced by a first node with respect to a second media referenced by a second node 
[tree and nodes of 0011, 0023, 0163-0166 and Figure 19]; wherein: the first and second 
nodes are configured as parallel nodes such that the first node that is a child of a parent 
node is rendered concurrently with the second node that is a child of the same parent 
node [tree and nodes of 0011, 0023, 0163-0166 and Figure 19]; and at least one node 
includes metadata [one of the tree elements is a master track file that contains indexing, 
timing and track metadata of 001], the metadata describing: rendering of the at least 
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one node [tinning metadata of 001 1]; and a collection of additional nodes to be 
dynamically modified when the original media timeline is rendered [metadata for 
dynamic changes to output during rendering of 0213-0221 and 0230]. 

Deutscher fails to expressly disclose the original media timeline is configured for 
dynamic creation such that at least one node is dynamically created while at least one 
of the media referenced by the plurality of nodes of the original media timeline is being 
rendered, as recited in the claims. In the same field of the invention, Chasen discloses 
receiving a change to a portion of the set of metadata and dynamically updating the 
display of the set of metadata and the hierarchy of category nodes to reflect the change 
[lines 15-22 of column 2]. Further, Chasen teaches making changes to metadata or 
nodes themselves, and dynamically updating the entire master tree by propagating 
those changes throughout the entire master tree, database collection, and graphical 
user interface display of the timeline nodes [lines 9-19 of column 4 and lines 52-64 of 
column 4]. The dynamic updates include changes to the nodes and/or metadata 
including additions and/or deletions [lines 45-62 of column 1 3 and lines 1 -7 of column 
15]. Thus, the nodes and/or metadata affected by the change are automatically updated 
without any further user interaction (other than initial change) through the propagated 
dynamic modification to the timeline. It would have been obvious to one of ordinary skill 
in the art, having the teachings of Deutscher and Chasen before him at the time the 
invention was made, to modify the dynamic updating taught by Deutscher to include 
propagating the changes automatically of Chasen, in order to obtain a dynamically 
updating the additions of nodes/metadata by propagating the changes without further 
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user interaction. One would have been motivated to make such a combination update a 
timeline without causing much delay and/or inconvenience to the user (i.e. without 
having to rebuild entire master tree or node table), as taught by Chasen [lines 9-19 of 
column 4 and lines 52-64 of column 4]. 

As per claim 2, Deutscher teaches: one or more nodes are configured as a 
sequence node such that one said node that is a child of the sequence node is 
rendered after another said node that is also a child of the sequence node [Fig 23]. 

As per claim 4, Deutscher teaches: one or more nodes is configured as a root 
node that specifies a starting point for rendering the original media timeline [root node of 
Figure 19]. 

As per claim 5, Deutscher teaches: the first and second nodes reference the 
respective first and second media utilizing respective first and second pointers [pointers 
to media of 0007]. 

As per claim 7, Deutscher teaches: metadata is a start time property that 
specifies when rendering of the at least one said node is to begin with respect to 
another said node [metadata of 0213-0221 and 0230]. 

As per claim 8, Deutscher teaches: at least one node is configured to reference 
an effect to be applied to an output of media referenced by the node [script commands 
and events of 0018]. 

As per claim 9, Chasen further teaches: the original media timeline is configured 
for dynamic loading such that metadata included in at least one said node specifies a 
collection of nodes to be loaded when the media timeline is rendered [making changes 
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to metadata or nodes themselves, and dynamically updating the entire master tree by 
propagating those changes throughout the entire master tree, database collection, and 
graphical user interface display of the timeline nodes of lines 9-19 of column 4 and lines 
52-64 of column 4]. 

As per claim 12, Deutscher teaches: at least one said node is configured for 
communication of events to another said node such that a change may be made to the 
original media timeline while the original media timeline is rendered [changes to an 
event on the timeline updates other of 0026]. 

As per claim 13, Deutscher teaches: the first and second said media have 
different formats [formats of 0007]. 

As per claim 14, Deutscher teaches: one or more computer readable media 
storing computer executable instructions that, when executed by a computer, direct the 
computer to perform the method above [computer readable media of 0073]. 

As per claim 15, Deutscher teaches a method comprising: generating a media 
timeline by an application, wherein the media timeline: includes a plurality of nodes 
[timeline of 001 1 and 0026]; and defines a presentation of a first said media referenced 
by a first said node with respect to a second said media referenced by a second said 
node, the presentation being configured to be output by one or more computers [tree 
and nodes of 001 1 , 0023, 01 63-01 66 and Figure 1 9]; and passing the media timeline to 
a timeline source for rendering [rendering of 0027-0028]. 

Deutscher fails to expressly disclose dynamic creation such that at least a first 
node grouping is created while media referenced by a second node grouping in the 
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media timeline is being rendered, as recited in the claims. In the same field of the 
invention, Chasen discloses receiving a change to a portion of the set of metadata and 
dynamically updating the display of the set of metadata and the hierarchy of category 
nodes to reflect the change [lines 15-22 of column 2]. Further, Chasen teaches making 
changes to metadata or nodes themselves, and dynamically updating the entire master 
tree by propagating those changes throughout the entire master tree, database 
collection, and graphical user interface display of the timeline nodes [lines 9-19 of 
column 4 and lines 52-64 of column 4]. The dynamic updates include changes to the 
nodes and/or metadata including additions and/or deletions [lines 45-62 of column 13 
and lines 1-7 of column 15]. Thus, the nodes and/or metadata affected by the change 
are automatically updated without any further user interaction (other than initial change) 
through the propagated dynamic modification to the timeline. It would have been 
obvious to one of ordinary skill in the art, having the teachings of Deutscher and Chasen 
before him at the time the invention was made, to modify the dynamic updating taught 
by Deutscher to include propagating the changes automatically of Chasen, in order to 
obtain a dynamically updating the additions of nodes/metadata by propagating the 
changes without further user interaction. One would have been motivated to make such 
a combination update a timeline without causing much delay and/or inconvenience to 
the user (i.e. without having to rebuild entire master tree or node table), as taught by 
Chasen [lines 9-1 9 of column 4 and lines 52-64 of column 4]. 

As per claim 16, the claim contains substantially the same subject matter as 
claim 13, and remains rejected using the same rationale. 
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As per claim 17, the claim contains substantially the same subject matter as 
claim 8, and remains rejected using the same rationale. 

As per claim 18, the claim contains substantially the same subject matter as 
claim 9, and remains rejected using the same rationale. 

As per claim 20, the claim contains substantially the same subject matter as 
claim 14, and remains rejected using the same rationale. 

As per claim 21 , Deutscher teaches a method for outputting a media presentation 
via one or more computers comprising: specifying an effect to be applied to one or more 
of a plurality of media when the media is rendered [script commands and events of 
0018]; and generating a media timeline configured for exposure via an application 
programming interface (API) [timeline of 0011 and 0026], wherein: the media timeline 
includes a plurality of nodes [tree and nodes of 001 1 , 0023, 01 63-01 66 and Figure 1 9]; 
two or more said nodes reference respective said media [tree and nodes of 001 1 , 0023, 
0163-0166 and Figure 19]; one or more of the plurality of nodes that reference the one 
or more plurality of media include metadata that controls the effect to be applied to one 
or more of the plurality of media when the media is rendered [metadata for dynamic 
changes to output during rendering of 0213-0221 and 0230]; and at least one node of 
the plurality of nodes includes metadata [one of the tree elements is a master track file 
that contains indexing, timing and track metadata of 001], the metadata describing: 
rendering of the at least one node of the plurality of nodes [timing metadata of 001 1]; 
and a collection of additional nodes of the plurality of nodes to be dynamically modified 
when the at least one node of the plurality of nodes is rendered [metadata for dynamic 
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changes to output during rendering of 0213-0221 and 0230]. 

Deutscher fails to expressly disclose the media timeline is configured for dynamic 
creation such that at least one node of the plurality of nodes is created while the media 
timeline is being rendered, as recited in the claims. In the same field of the invention, 
Chasen discloses receiving a change to a portion of the set of metadata and 
dynamically updating the display of the set of metadata and the hierarchy of category 
nodes to reflect the change [lines 15-22 of column 2]. Further, Chasen teaches making 
changes to metadata or nodes themselves, and dynamically updating the entire master 
tree by propagating those changes throughout the entire master tree, database 
collection, and graphical user interface display of the timeline nodes [lines 9-19 of 
column 4 and lines 52-64 of column 4]. The dynamic updates include changes to the 
nodes and/or metadata including additions and/or deletions [lines 45-62 of column 13 
and lines 1-7 of column 15]. Thus, the nodes and/or metadata affected by the change 
are automatically updated without any further user interaction (other than initial change) 
through the propagated dynamic modification to the timeline. It would have been 
obvious to one of ordinary skill in the art, having the teachings of Deutscher and Chasen 
before him at the time the invention was made, to modify the dynamic updating taught 
by Deutscher to include propagating the changes automatically of Chasen, in order to 
obtain a dynamically updating the additions of nodes/metadata by propagating the 
changes without further user interaction. One would have been motivated to make such 
a combination update a timeline without causing much delay and/or inconvenience to 
the user (i.e. without having to rebuild entire master tree or node table), as taught by 
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Chasen [lines 9-1 9 of column 4 and lines 52-64 of column 4]. 

As per claim 22, Deutscher teaches: the effect is a simple effect provided by a 
software component that is configured to: receive a single stream of media; apply the 
effect to the single stream; and output the applied single stream [script commands and 
events of 0018]. 

As per claim 23, Deutscher teaches: the effect is a composite effect provided by 
a software component that is configured to: receive at least two streams of media; apply 
the effect at least two streams; and output a applied single stream of media composed 
of the applied at least two streams [script commands and events of 0018]. 

As per claim 24, Deutscher teaches: the effect is a composite effect provided by 
a software component that is configured to analyze at least two streams of media or 
output at least two streams of media [script commands and events of 0018]. 

As per claim 25, Deutscher teaches: the effect is a transition effect to be applied 
as a transition from a first media referenced by a first said node to a second media 
referenced by a second node [script commands and events of 0018]. 

As per claim 26, the claim contains substantially the same subject matter as 
claim 7, and remains rejected using the same rationale. 

As per claim 28, the claim contains substantially the same subject matter as 
claim 9, and remains rejected using the same rationale. 

As per claim 30, the claim contains substantially the same subject matter as 
claim 11, and remains rejected using the same rationale. 

As per claim 31 , the claim contains substantially the same subject matter as 
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claim 12, and remains rejected using the same rationale. 

As per claim 32, the claim contains substantially the same subject matter as 
claim 14, and remains rejected using the same rationale. 

As per claim 33, Deutscher teaches in a media timeline exposed via an 
application programming interface and having a plurality of nodes, a method 
comprising: rendering [rendering of 0027-0028] a first media item of a plurality of media 
items, at least one of the plurality of media items comprising a streaming media item, 
the first media item being referenced by a first node of a first node type of a plurality of 
node types, the plurality of node types comprising a sequence node type that includes 
metadata describing a rendering order of a plurality of leaf nodes to the sequence node 
[tree and nodes of 001 1 , 0023, 0163-0166 and Figure 19]; receiving a call for a second 
node that references a second media item [call for items of 0100 of timeline of 001 1 and 
0026]; and creating the second node of a second node type of the plurality of node 
types, while rendering the first media item [rendering presentation timeline of 0027- 
0028]; and wherein the media timeline is configured for dynamic updating such that 
metadata included in at least one node specifies a collection of nodes to be modified 
when the at least one node is loaded [metadata for dynamic changes to output during 
rendering of 0213-0221 and 0230]. 

Deutscher may fail to expressly disclose creating automatically, without user 
intervention, the second node of a second node type and the media timeline is 
configured for automatic dynamic updating, as recited in the claims. In the same field of 
the invention, Chasen discloses receiving a change to a portion of the set of metadata 
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and dynamically updating the display of the set of metadata and the hierarchy of 
category nodes to reflect the change [lines 15-22 of column 2]. Further, Chasen 
teaches making changes to metadata or nodes themselves, and dynamically updating 
the entire master tree by propagating those changes throughout the entire master tree, 
database collection, and graphical user interface display of the timeline nodes [lines 9- 
19 of column 4 and lines 52-64 of column 4]. The dynamic updates include changes to 
the nodes and/or metadata including additions and/or deletions [lines 45-62 of column 
13 and lines 1-7 of column 15]. Thus, the nodes and/or metadata affected by the 
change are automatically updated without any further user interaction (other than initial 
change) through the propagated dynamic modification to the timeline. It would have 
been obvious to one of ordinary skill in the art, having the teachings of Deutscher and 
Chasen before him at the time the invention was made, to modify the dynamic updating 
taught by Deutscher to include propagating the changes automatically of Chasen, in 
order to obtain a dynamically updating the additions of nodes/metadata by propagating 
the changes without further user interaction. One would have been motivated to make 
such a combination update a timeline without causing much delay and/or inconvenience 
to the user (i.e. without having to rebuild entire master tree or node table), as taught by 
Chasen [lines 9-1 9 of column 4 and lines 52-64 of column 4]. 

As per claim 34, Deutscher teaches: rendering a second media item referenced 
by the second node when the rendering of the first media item is completed [rendering 
presentation timeline of 0027-0028]. 

As per claim 35, Deutscher teaches: rendering the second media item referenced 



Application/Control Number: 10/782,734 Page 13 

Art Unit: 2179 

by the second node; receiving a call for a third node that references a third media item; 
and creating the third node [rendering of 0027-0028, calling for items of a timeline of 
0100]. 

As per claim 37, Deutscher teaches: at least one node is configured to reference 
an effect to be applied to an output of media referenced by the node [script commands 
and events of 0018]. 

As per claim 38, Deutscher teaches: at least one node is specified as read-only 
[cannot be edited of 0017]. 

As per claim 39, Deutscher teaches: at least one said node is configured for 
communication of events to another said node such that a change may be made to the 
media timeline while the media timeline is rendered [changes to an event on the 
timeline updates other of 0026]. 

As per claim 40, Deutscher teaches: one or more computer readable media 
storing computer executable instructions that, when executed by a computer, direct the 
computer to perform the method above [computer readable media of 0073]. 

As per claim 41 , Deutscher teaches in a media timeline exposed via an 
application programming interface, the media timeline having a plurality of nodes, at 
least two of which reference respective media, one or more nodes each having 
metadata that references a node grouping, a method comprising: utilizing a computer to 
load a first said node for rendering [rendering of 0027-0028], wherein the first node is 
selected from a plurality of node types, the plurality of node types comprising a parallel 
node type that includes metadata specifying a plurality of leaf nodes that are rendered 
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simultaneously [rendering of 0027-0028 of tree and nodes of 001 1 , 0023, 01 63-01 66 
and Figure 19]; examining metadata associated with the first node to determine a first 
said node grouping to be loaded in conjunction with the first node [metadata of 0213- 
0221 and 0230]; loading each said node referenced by the first node grouping; 
rendering the first node grouping [rendering of 0027-0028 of tree and nodes of 001 1 , 
0023, 0163-0166 and Figure 19]; examining one second node in the first node grouping 
to determine a second said node grouping, wherein the examining the at least one 
second node in the first node grouping is performed during the rendering of the first 
node grouping [rendering presentation timeline of 0027-0028]; loading each node 
referenced by the second node grouping [rendering of 0027-0028 of tree and nodes of 
0011, 0023, 0163-0166 and Figure 19]; and rendering the second node grouping when 
the rendering of the first said node grouping is completed [rendering of 0027-0028 of 
tree and nodes of 001 1 , 0023, 01 63-01 66 and Figure 1 9], wherein: and at least a fourth 
node is configured for communication of an initiated event to a fifth node which has 
subscribed to receive events initiated by the fourth node, such that a change is made to 
one or more nodes in the media timeline that are affected by the initiated event 
[changes to an event on the timeline updates other of 0026], wherein the one or more 
nodes of the media timeline that are affected by the initiated event are dynamically 
updated [changes to an event on the timeline updates other of 0026]. 

Deutscher fails to expressly disclose the media timeline is configured for dynamic 
creation where at least a third node is created while the media timeline is being 
rendered, the dynamic creation of the third node being performed by a node source that 
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includes data that defines properties and interrelationships of the created third node 
with respect to one or more nodes in the first node grouping or one or more nodes in the 
second node grouping, as recited in the claims. In the same field of the invention, 
Chasen discloses receiving a change to a portion of the set of metadata and 
dynamically updating the display of the set of metadata and the hierarchy of category 
nodes to reflect the change [lines 15-22 of column 2]. Further, Chasen teaches making 
changes to metadata or nodes themselves, and dynamically updating the entire master 
tree by propagating those changes throughout the entire master tree, database 
collection, and graphical user interface display of the timeline nodes [lines 9-19 of 
column 4 and lines 52-64 of column 4]. The dynamic updates include changes to the 
nodes and/or metadata including additions and/or deletions [lines 45-62 of column 13 
and lines 1-7 of column 15]. Thus, the nodes and/or metadata affected by the change 
are automatically updated without any further user interaction (other than initial change) 
through the propagated dynamic modification to the timeline. It would have been 
obvious to one of ordinary skill in the art, having the teachings of Deutscher and Chasen 
before him at the time the invention was made, to modify the dynamic updating taught 
by Deutscher to include propagating the changes automatically of Chasen, in order to 
obtain a dynamically updating the additions of nodes/metadata by propagating the 
changes without further user interaction. One would have been motivated to make such 
a combination update a timeline without causing much delay and/or inconvenience to 
the user (i.e. without having to rebuild entire master tree or node table), as taught by 
Chasen [lines 9-19 of column 4 and lines 52-64 of column 4]. 
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As per claim 44, the claim contains substantially the same subject matter as 
claim 8, and remains rejected using the same rationale. 

As per claim 45, the claim contains substantially the same subject matter as 
claim 11, and remains rejected using the same rationale. 

As per claim 47, the claim contains substantially the same subject matter as 
claim 13, and remains rejected using the same rationale. 

As per claim 48, the claim contains substantially the same subject matter as 
claim 14, and remains rejected using the same rationale. 

As per claim 49, Deutscher teaches: a method comprising: exposing a media 
timeline via an application programming interface (API) [timeline of 001 1 and 0026], the 
media timeline having a plurality of nodes, two or more nodes each referencing 
respective media at least one of which comprises streaming media [tree and nodes of 
001 1 , 0023, 01 63-01 66 and Figure 1 9], rendering a first said node to output a 
referenced first said media [rendering of 0027-0028 of tree and nodes of 001 1 , 0023, 
01 63-01 66 and Figure 1 9 for the output of a presentation]; during the rendering of the 
first node, changing one or more properties of a second said node; and initiating, by an 
event generator located on the second said node, an event for communication to a 
parent said node of the second said node, wherein the event describes the changing 
[changes to an event on the timeline updates others of 0026]. 

Deutscher fails to expressly disclose the media timeline is configured for dynamic 
loading such that metadata included in at least one node specifies a collection of nodes 
to be loaded when the media timeline is rendered, and during the rendering of the first 
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node, dynamically changing one or more properties of a second node, as recited in the 
claims. In the same field of the invention, Chasen discloses receiving a change to a 
portion of the set of metadata and dynamically updating the display of the set of 
metadata and the hierarchy of category nodes to reflect the change [lines 15-22 of 
column 2]. Further, Chasen teaches making changes to metadata or nodes 
themselves, and dynamically updating the entire master tree by propagating those 
changes throughout the entire master tree, database collection, and graphical user 
interface display of the timeline nodes [lines 9-19 of column 4 and lines 52-64 of column 
4]. The dynamic updates include changes to the nodes and/or metadata including 
additions and/or deletions [lines 45-62 of column 1 3 and lines 1 -7 of column 1 5]. Thus, 
the nodes and/or metadata affected by the change are automatically updated without 
any further user interaction (other than initial change) through the propagated dynamic 
modification to the timeline. It would have been obvious to one of ordinary skill in the 
art, having the teachings of Deutscher and Chasen before him at the time the invention 
was made, to modify the dynamic updating taught by Deutscher to include propagating 
the changes automatically of Chasen, in order to obtain a dynamically updating the 
additions of nodes/metadata by propagating the changes without further user 
interaction. One would have been motivated to make such a combination update a 
timeline without causing much delay and/or inconvenience to the user (i.e. without 
having to rebuild entire master tree or node table), as taught by Chasen [lines 9-19 of 
column 4 and lines 52-64 of column 4]. 

As per claim 50, Deutscher teaches: the event is communicated to at least one 



Application/Control Number: 10/782,734 Page 18 

Art Unit: 2179 

of an application over the API [changes to an event on the timeline updates other of 
0026] and a timeline source for rendering the media timeline [rendering presentation 
timeline of 0027-0028]. 

As per claim 51 , Deutscher teaches: one of the properties is node changed event 
[edit properties for change events of 0201]. 

As per claim 52, Deutscher teaches: one or more nodes is configured as a root 
node that specifies a starting point for rendering the media timeline [root node of Figure 
19]. 

As per claim 54, Deutscher teaches a media timeline but fails to expressly 
disclose the media timeline is configured for dynamic creation such that at least one 
node is created while the media timeline is being rendered, as recited in the claims. In 
the same field of the invention, Chasen discloses receiving a change to a portion of the 
set of metadata and dynamically updating the display of the set of metadata and the 
hierarchy of category nodes to reflect the change [lines 15-22 of column 2]. Further, 
Chasen teaches making changes to metadata or nodes themselves, and dynamically 
updating the entire master tree by propagating those changes throughout the entire 
master tree, database collection, and graphical user interface display of the timeline 
nodes [lines 9-1 9 of column 4 and lines 52-64 of column 4]. The dynamic updates 
include changes to the nodes and/or metadata including additions and/or deletions 
[lines 45-62 of column 13 and lines 1-7 of column 15]. Thus, the nodes and/or metadata 
affected by the change are automatically updated without any further user interaction 
(other than initial change) through the propagated dynamic modification to the timeline. 
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It would have been obvious to one of ordinary skill in the art, having the teachings of 
Deutscher and Chasen before him at the time the invention was made, to modify the 
dynamic updating taught by Deutscher to include propagating the changes 
automatically of Chasen, in order to obtain a dynamically updating the additions of 
nodes/metadata by propagating the changes without further user interaction. One would 
have been motivated to make such a combination update a timeline without causing 
much delay and/or inconvenience to the user (i.e. without having to rebuild entire 
master tree or node table), as taught by Chasen [lines 9-19 of column 4 and lines 52-64 
of column 4]. 

As per claim 55, Deutscher teaches: at least one said node is configured for 
communication of events to another said node such that a change may be made to the 
media timeline while the media timeline is rendered [changes to an event on the 
timeline updates other of 0026]. 

As per claim 56, Deutscher teaches: at least one node is configured to reference 
an effect to be applied to an output of media referenced by the node [script commands 
and events of 0018]. 

As per claim 57, Deutscher teaches: one or more computer readable media 
storing computer executable instructions that, when executed by a computer, direct the 
computer to perform the method above [computer readable media of 0073]. 

As per claim 58, Deutscher teaches an application programming interface 
embodied on a computer storage medium, which when interfaced with a computer, 
exposes a media timeline to one or more independent applications, the application 
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programming interface comprising: each said node includes metadata that describes 
the node [metadata of 0213-0221 and 0230], the metadata comprising a source object 
property that specifies a source object which can resolve to a media source that 
provides the media referenced by the node [URL associated with node of 0165]; one or 
more said nodes reference a corresponding media item comprising a streaming media 
item [tree and nodes of 001 1 , 0023, 01 63-01 66 and Figure 1 9]; the plurality of nodes 
are arranged in a tree structure [tree and nodes of 001 1 , 0023, 01 63-01 66 and Figure 
1 9]; and the arrangement of the plurality of nodes, one to another, describes an order 
for rendering the plurality of nodes [tree and nodes of 001 1, 0023, 0163-0166 and 
Figure 1 9; timeline of 001 1 and Figure 23]. 

Deutscher fails to expressly disclose wherein the media timeline is configured for 
dynamic creation such that at least one node is created while the media timeline is 
rendered and at least one node is dynamically updated in response to the at least one 
node being created, as recited in the claims. In the same field of the invention, Chasen 
discloses receiving a change to a portion of the set of metadata and dynamically 
updating the display of the set of metadata and the hierarchy of category nodes to 
reflect the change [lines 15-22 of column 2]. Further, Chasen teaches making changes 
to metadata or nodes themselves, and dynamically updating the entire master tree by 
propagating those changes throughout the entire master tree, database collection, and 
graphical user interface display of the timeline nodes [lines 9-19 of column 4 and lines 
52-64 of column 4]. The dynamic updates include changes to the nodes and/or 
metadata including additions and/or deletions [lines 45-62 of column 13 and lines 1-7 of 
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column 15]. Thus, the nodes and/or metadata affected by the change are automatically 
updated without any further user interaction (other than initial change) through the 
propagated dynamic modification to the timeline. It would have been obvious to one of 
ordinary skill in the art, having the teachings of Deutscher and Chasen before him at the 
time the invention was made, to modify the dynamic updating taught by Deutscher to 
include propagating the changes automatically of Chasen, in order to obtain a 
dynamically updating the additions of nodes/metadata by propagating the changes 
without further user interaction. One would have been motivated to make such a 
combination update a timeline without causing much delay and/or inconvenience to the 
user (i.e. without having to rebuild entire master tree or node table), as taught by 
Chasen [lines 9-1 9 of column 4 and lines 52-64 of column 4]. 

As per claim 59, Deutscher teaches a stop time property that specifies when 
rendering of the node is to stop with respect to another node [metadata of 0213-0221 
and 0230]. 

As per claim 60, the claim contains substantially the same subject matter as 
claim 8, and remains rejected using the same rationale. 

As per claim 61 , the claim contains substantially the same subject matter as 
claim 6, and remains rejected using the same rationale. 

As per claim 62, the claim contains substantially the same subject matter as 
claim 9, and remains rejected using the same rationale. 

As per claim 64, the claim contains substantially the same subject matter as 
claim 11, and remains rejected using the same rationale. 
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As per claim 65, the claim contains substantially the same subject matter as 
claim 12, and remains rejected using the same rationale. 

As per claim 66, Deutscher teaches an application programming interface stored 
on a computer storage medium, that when accessed by a computer facilitates acts 
comprising: exposing a media timeline to one or more independent applications, the 
media timeline comprising a plurality of nodes callable by one application, wherein: two 
or more said nodes reference respective media, one of which comprises streaming 
media [tree and nodes of 0011, 0023, 0163-0166 and Figure 19; timeline of 0011 and 
Figure 23]; the plurality of nodes are arranged in a hierarchy to include a parent said 
node and a child said node [tree and nodes of 001 1 , 0023, 01 63-01 66 and Figure 1 9; 
timeline of 001 1 and Figure 23]; and the child said node is configured for initiating an 
event for communication to the parent said node, wherein the event: is configured such 
that a change may be made to one or more properties of the child node while the media 
timeline is rendered and describes the change such that additional nodes associated 
with the child node are updated in accordance with the communicated event [changes 
to an event on the timeline updates other of 0026]. 

Deutscher may fail to expressly disclose a change may be made to one or more 
properties of the child node while the media timeline is rendered and describes the 
change such that additional nodes associated with the child node are dynamically 
updated in accordance with the communicated event, as recited in the claim. In the 
same field of the invention, Chasen discloses receiving a change to a portion of the set 
of metadata and dynamically updating the display of the set of metadata and the 
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hierarchy of category nodes to reflect the change [lines 1 5-22 of column 2]. Further, 
Chasen teaches making changes to metadata or nodes themselves, and dynamically 
updating the entire master tree by propagating those changes throughout the entire 
master tree, database collection, and graphical user interface display of the timeline 
nodes [lines 9-1 9 of column 4 and lines 52-64 of column 4]. The dynamic updates 
include changes to the nodes and/or metadata including additions and/or deletions 
[lines 45-62 of column 13 and lines 1-7 of column 15]. Thus, the nodes and/or metadata 
affected by the change are automatically updated without any further user interaction 
(other than initial change) through the propagated dynamic modification to the timeline. 
It would have been obvious to one of ordinary skill in the art, having the teachings of 
Deutscher and Chasen before him at the time the invention was made, to modify the 
dynamic updating taught by Deutscher to include propagating the changes 
automatically of Chasen, in order to obtain a dynamically updating the additions of 
nodes/metadata by propagating the changes without further user interaction. One would 
have been motivated to make such a combination update a timeline without causing 
much delay and/or inconvenience to the user (i.e. without having to rebuild entire 
master tree or node table), as taught by Chasen [lines 9-1 9 of column 4 and lines 52-64 
of column 4]. 

As per claim 67, Deutscher teaches: wherein another node, which is not a parent 
of the child node, subscribes to the child node to receive the event [changes to an event 
on the timeline updates other of 0026]. 

As per claim 68, Deutscher teaches: the event is initiated by the child node; and 
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one or more events initiated by children of the child node [changes to an event on the 
timeline updates other of 0026]. 

As per claim 70, the claim contains substantially the same subject matter as 
claim 51, and remains rejected using the same rationale. 

As per claim 71 , the claim contains substantially the same subject matter as 
claim 4, and remains rejected using the same rationale. 

As per claim 72, the claim contains substantially the same subject matter as 
claim 9, and remains rejected using the same rationale. 

As per claim 73, the claim contains substantially the same subject matter as 
claim 10, and remains rejected using the same rationale. 

As per claim 74, the claim contains substantially the same subject matter as 
claim 8, and remains rejected using the same rationale. 

As per claim 75, the claim contains substantially the same subject matter as 
claim 11, and remains rejected using the same rationale. 

As per claim 76, Deutscher teaches an application programming interface 
embodied in an infrastructure layer of a computer that, when interacted with by an 
application facilitates actions comprising: exposing a media timeline comprising two or 
more nodes to the application [tree and nodes of 001 1 , 0023, 01 63-01 66 and Figure 1 9; 
timeline of 001 1 and Figure 23]; enabling the application to call any of the one or more 
nodes [call for items of 01 00 of timeline of 001 1 and 0026], wherein each of the one or 
more nodes: references corresponding media, at least one of the corresponding media 
comprising streaming media while another of the corresponding media does not include 
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streaming media [media of 0007]; includes metadata describing one or more properties 
for rendering corresponding media [metadata of 0213-0221 and 0230]; and includes 
metadata specifying the node as read-only [input and output nodes are not changed of 
0081]. 

Deutscher fails to expressly disclose configuring the media timeline for dynamic 
creation such that at least one of the one or more nodes is created while the media 
timeline is being rendered, as recited in the claims. In the same field of the invention, 
Chasen discloses receiving a change to a portion of the set of metadata and 
dynamically updating the display of the set of metadata and the hierarchy of category 
nodes to reflect the change [lines 15-22 of column 2]. Further, Chasen teaches making 
changes to metadata or nodes themselves, and dynamically updating the entire master 
tree by propagating those changes throughout the entire master tree, database 
collection, and graphical user interface display of the timeline nodes [lines 9-19 of 
column 4 and lines 52-64 of column 4]. The dynamic updates include changes to the 
nodes and/or metadata including additions and/or deletions [lines 45-62 of column 13 
and lines 1-7 of column 15]. Thus, the nodes and/or metadata affected by the change 
are automatically updated without any further user interaction (other than initial change) 
through the propagated dynamic modification to the timeline. It would have been 
obvious to one of ordinary skill in the art, having the teachings of Deutscher and Chasen 
before him at the time the invention was made, to modify the dynamic updating taught 
by Deutscher to include propagating the changes automatically of Chasen, in order to 
obtain a dynamically updating the additions of nodes/metadata by propagating the 
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changes without further user interaction. One would have been motivated to make such 
a combination update a timeline without causing much delay and/or inconvenience to 
the user (i.e. without having to rebuild entire master tree or node table), as taught by 
Chasen [lines 9-1 9 of column 4 and lines 52-64 of column 4]. 

As per claim 77, Deutscher teaches a system comprising: a plurality of media 
comprising streaming media [media of 0011]; a plurality of applications [application 
programs of 0074]; and an infrastructure layer that: provides an application 
programming interface (API) for interaction by the plurality of applications with the 
plurality of media when any said application is executed [application programming 
interface of 0040]; and exposes a media timeline [ timeline of 001 1 and Figure 23], 
callable by the plurality of applications via the API upon an execution thereof [call of 
0100], and that defines a presentation of the plurality of media [timeline presentation of 
0011], wherein the media timeline: includes a plurality of nodes that each reference 
respective media [tree and nodes of 0011, 0023, 0163-0166 and Figure 19]. 

Deutscher fails to expressly disclose wherein the media timeline is configured for 
dynamic creation such that at least one node is created while the media timeline is 
rendered and is configured for dynamic loading such that metadata included in the at 
least one node created specifies a collection of nodes to be loaded when the media 
timeline is rendered, as recited in the claims. In the same field of the invention, Chasen 
discloses receiving a change to a portion of the set of metadata and dynamically 
updating the display of the set of metadata and the hierarchy of category nodes to 
reflect the change [lines 15-22 of column 2]. Further, Chasen teaches making changes 
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to metadata or nodes themselves, and dynamically updating the entire master tree by 
propagating those changes throughout the entire master tree, database collection, and 
graphical user interface display of the timeline nodes [lines 9-19 of column 4 and lines 
52-64 of column 4]. The dynamic updates include changes to the nodes and/or 
metadata including additions and/or deletions [lines 45-62 of column 13 and lines 1-7 of 
column 15]. Thus, the nodes and/or metadata affected by the change are automatically 
updated without any further user interaction (other than initial change) through the 
propagated dynamic modification to the timeline. It would have been obvious to one of 
ordinary skill in the art, having the teachings of Deutscher and Chasen before him at the 
time the invention was made, to modify the dynamic updating taught by Deutscher to 
include propagating the changes automatically of Chasen, in order to obtain a 
dynamically updating the additions of nodes/metadata by propagating the changes 
without further user interaction. One would have been motivated to make such a 
combination update a timeline without causing much delay and/or inconvenience to the 
user (i.e. without having to rebuild entire master tree or node table), as taught by 
Chasen [lines 9-1 9 of column 4 and lines 52-64 of column 4]. 

As per claim 78, the claim contains substantially the same subject matter as 
claim 8, and remains rejected using the same rationale. 

As per claim 79, Deutscher teaches: the media timeline defines a presentation of 
a first media referenced by a first node with respect to a second media referenced by a 
second node [tree and nodes of 001 1 , 0023, 01 63-01 66 and Figure 1 9; timeline of 001 1 
and Figure 23]; and at least one said node includes metadata that describes rendering 
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of the at least one node [metadata of 0213-0221 and 0230]. 

As per claim 82, Deutscher teaches: at least one node is specified as read-only 
[cannot be edited of 0017]. 

As per claim 83, Deutscher teaches: at least one said node is configured for 
communication of events to another said node such that a change may be made to the 
media timeline while the media timeline is rendered [changes to an event on the 
timeline updates other of 0026]. 

As per claim 84, Deutscher teaches a computer comprising: a processor and 
memory configured to maintain: a plurality of media [media of 001 1]; a plurality of 
applications [application programs of 0074]; wherein each said application is configured 
to request at least one of editing, encoding, and rendering of the plurality of media 
[rendering of 0027-0028]; and an infrastructure layer configured to: provide an 
application programming interface (API) for interaction by the plurality of applications 
with the plurality of media [application programming interface of 0040]; and expose a 
media timeline [ timeline of 001 1 and Figure 23], callable by the plurality of applications 
via the API upon an execution thereof [call of 0100], and that defines a presentation of 
the plurality of media [timeline presentation of 001 1], wherein the metadata describes: 
initiating rendering of the plurality of nodes [metadata of 0213-0221 and 0230]; 
properties and interrelationships of the plurality of nodes [metadata of 0213-0221 and 
0230]; and node types of the plurality of nodes [metadata of 0213-0221 and 0230]; and 
dynamic change to the media timeline such that a group of nodes affected by a 
modification to an associated node are automatically updated in accordance with the 
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modification as specified in the properties and interrelationships of the plurality of nodes 
[metadata for dynamic changes to output during rendering of 0213-0221 and 0230]; at 
least one node that is configured for communication of events to another node that is 
configured for communication of events to another node such that a change may be 
made to the media timeline while the media timeline is being rendered [changes to an 
event on the timeline updates other of 0026]; and at least one node that is a parallel 
node that provides simultaneous rendering of at least two child nodes the child nodes 
including respective metadata and having respective pointers to respective media [tree 
and nodes of 001 1 , 0023, 01 63-01 66 and Figure 1 9; timeline of 001 1 and Figure 23], 

Deutscher fails to expressly disclose wherein the media timeline specifies 
delayed creation of one or more said nodes when the media timeline is rendered, as 
recited in the claims. In the same field of the invention, Chasen discloses receiving a 
change to a portion of the set of metadata and dynamically updating the display of the 
set of metadata and the hierarchy of category nodes to reflect the change [lines 15-22 
of column 2]. Further, Chasen teaches making changes to metadata or nodes 
themselves, and dynamically updating the entire master tree by propagating those 
changes throughout the entire master tree, database collection, and graphical user 
interface display of the timeline nodes [lines 9-19 of column 4 and lines 52-64 of column 
4]. The dynamic updates include changes to the nodes and/or metadata including 
additions and/or deletions [lines 45-62 of column 1 3 and lines 1 -7 of column 1 5]. Thus, 
the nodes and/or metadata affected by the change are automatically updated without 
any further user interaction (other than initial change) through the propagated dynamic 
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modification to the timeline. It would have been obvious to one of ordinary skill in the 
art, having the teachings of Deutscher and Chasen before him at the time the invention 
was made, to modify the dynamic updating taught by Deutscher to include propagating 
the changes automatically of Chasen, in order to obtain a dynamically updating the 
additions of nodes/metadata by propagating the changes without further user 
interaction. One would have been motivated to make such a combination update a 
timeline without causing much delay and/or inconvenience to the user (i.e. without 
having to rebuild entire master tree or node table), as taught by Chasen [lines 9-19 of 
column 4 and lines 52-64 of column 4]. 

As per claim 86, the claim contains substantially the same subject matter as 
claim 9, and remains rejected using the same rationale. 

As per claim 87, the claim contains substantially the same subject matter as 
claim 8, and remains rejected using the same rationale. 

As per claim 88, the claim contains substantially the same subject matter as 
claim 12, and remains rejected using the same rationale. 

As per claims 89 and 90, Deutscher teaches: a root node that specifies a starting 
point for rendering the media timeline [tree and nodes of 001 1 , 0023, 01 63-01 66 and 
Figure 19; timeline of 0011 and Figure 23], the root node including metadata that 
describes how rendering is to be initiated [one of the tree elements is a master track file 
that contains indexing, timing and track metadata of 001]; a leaf node that directly maps 
to media to be rendered and output, the leaf node including metadata that describes 
how rendering is supposed to be initiated; a sequence node that includes metadata that 



Application/Control Number: 10/782,734 Page 31 

Art Unit: 2179 

describes a rendering order of a plurality of leaf nodes to the sequence node; and a 
parallel node that includes metadata specifying a plurality of leaf nodes that are 
rendered simultaneously [tree and nodes of 0011, 0023, 0163-0166 and Figure 19; 
timeline of 001 1 and Figure 23]. 

As per claim 94, Chasen teaches wherein the media timeline is configured for 
dynamic loading such that metadata included in at least one node specifies a collection 
of nodes to be loaded when the media timeline is rendered, the collection of nodes 
comprising a parallel node that includes metadata specifying a plurality of leaf nodes for 
simultaneous rendering [receiving a change to a portion of the set of metadata and 
dynamically updating the display of the set of metadata and the hierarchy of category 
nodes to reflect the change of lines 15-22 of column 2, making changes to metadata or 
nodes themselves, and dynamically updating the entire master tree by propagating 
those changes throughout the entire master tree, database collection, and graphical 
user interface display of the timeline nodes of lines 9-19 of column 4 and lines 52-64 of 
column 4]. 

As per claim 95, Chasen teaches wherein one or more nodes of the media 
timeline subscribes to events initiated by other nodes of the media timeline [receiving a 
change to a portion of the set of metadata and dynamically updating the display of the 
set of metadata and the hierarchy of category nodes to reflect the change of lines 1 5-22 
of column 2, making changes to metadata or nodes themselves, and dynamically 
updating the entire master tree by propagating those changes throughout the entire 
master tree, database collection, and graphical user interface display of the timeline 
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nodes of lines 9-1 9 of column 4 and lines 52-64 of column 4]. 

Claims 11 and 91-93 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Deutscher/Chasen as applied to claim 1 above, and further in 
view of Smith (US 2003/0167356). 

As per claim 1 1 , Deutscher/Chasen teaches not editing the timeline [Deutscher 
0017] but fails to expressly disclose: at least one node of the original media timeline is 
specified as read-only by creating a read-only wrapper of the original media timeline, as 
recited in the claim. In the same field of the invention Smith teaches specifying a read- 
only property by using a wrapper class [19562-19579]. It would have been obvious to 
one of ordinary skill in the art, having the teachings of Deutscher/Chasen and Smith 
before him at the time the invention was made, to modify metadata properties taught by 
Deutscher/Chasen to include a wrapper of Smith, in order to obtain a read-only wrapper 
to implement a read-only property. One would have been motivated to make such a 
combination to prevent modifications, as taught by Smith [19570]. 

As per claim 91 , Smith teaches wherein a node specified as read-only disables 
functionality comprising one or more of: modifying the media timeline by other 
components while allowing dynamic changes to the original media timeline; or adding 
new children to the original media timeline while allowing other components to set 
custom metadata on the original media timeline nodes [prevent modifications of 19570]. 

As per claim 92, Smith teaches wherein the read-only wrapper contains cloned 
nodes that mirror a structure of the original media timeline [cloned instance of 10515]. 

As per claim 93, Smith teaches wherein the cloned nodes are configured to 
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subscribe to events generated on the nodes of the original media timeline such that the 
structure of cloned nodes is kept updated as the original media timeline changes 
[cloned instance supporting existing instance of 10515]. 

Response to Arguments 
Applicant's arguments with respect to Claims 1-2, 4-5, 7-9, 12-18, 20-26, 28, 30- 
35, 37-41 , 44-45, 47-52, 54-62, 64-68, 70-79, 82-87 and 89-90 have been considered 
but are moot in view of the new ground(s) of rejection made in view of Deutscher (US 
2004/0001106) and Chasen (US 6,760,721). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ENRIQUE W. ITURRALDE whose telephone number is 
(571 )270-3627. The examiner can normally be reached on Monday-Thursday 9 AM - 5 
AM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Weilun Lo can be reached on (571)272-4847. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

IE. W. I./ 

Examiner, Art Unit 2179 
/Ba Huynh/ 

Primary Examiner, Art Unit 2179 



